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ABSTRACT 

Within high school chemistry the topic of acids, 
bases, and pH is particularly challenging because robust 
understanding of the topic depends heavily on the student possessing 
deep concepts of at cms, molecules, ions, and chemical reactions. 
Since knowledge is acquired and stored in a dynamic structure, it was 
investigated in this study how knowledge changed as a result of the 
student ♦s exposure to a particular type of learning task. Two areas 
of interest were targeted: the change in the students' understanding 
of acids, bases, and pH over the course of the treatment and the type 
of thought processes in which the students engage<1 while performing 
the treatment tasks. These understandings and thought processes were 
followed as a function of three levels of information presented by 
the technology? low level as represented by the use of chemical 
indicator solutions, intermediate level as represented by the use of 
a pH meter, and high level as represented by the use of a 
microcomputer-interfaced electronic pH probe. Reported in this paper 
are students' understandings prior to and after interacting with 
these technologies. Verbal data and drawings obtained in clinical 
interviews were used to construct concept maps and to 2Uialyze 
students' molecular concepts. Experts were also interviewed, and 
their concept m^s were analyzed to identify critical nodes on their 
understanding of acids, bases, and pH. The concept ^ps and drawings 
were analyzed and two general conclusions reached: (1) students using 
microcomputer-based laboratory (MBL) activities appeared to construct 
more powerful and more meaningful chemical concepts; (2) the 
microcomputer group's high rates of both erroneous and acceptable 
links provide evidence that these students were positively engaged in 
restructuring their chemical knowledge. MBL appears to help students 
develop deeper understanding of acids, bases, and pH concepts, as 
indicated by the concept maps showing more detailed differentiation 
and integration. Examples of student's amd expert's concept maps are 
appended. (KR) 
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ftgblan SWflnfnt 

In this f^x^ we investigated students' uiulCTStamiii^ of x^, base, md pH a)XKq^ b^re and after 
a seras ol acid-base titrations using three leduK>log^ chonical indicators, pH meters, and 
infcroc om| mtBr - based laboratories (MBU. Each of tl^se tedtnol<^e$ provide tl^ teama- with a 
differeiU tevel of infcmnation. Learners u^ng tl^ the di«mical indioitOT oouUI follow tiie color changes 
whkh occurred as the base was added to the add. L^n^rs using the pH meter could recced the volume 
of baseaml AepH vali^ after each additk>n oi base, and could also c^^^e the xxwven^t of the 
pH meter i^edle after each iKklition of base. L^mers usii^ the microcon^uter had availaUe 
intomaticm on the pH value after each addition of base ai^ could also ot^rve the on-screen graph of 
pH vsw volunte of base which was fonned as the tibation progressed* Our working hypothesis was that 
the of inlOTmatkm presented by the techiwk^ would intend with the instructional tasks to 
infhiDioe 6ie under^anding of add/base chemistry developed by the learner. 

Thmrtical gjckgrownd 

Within hi^ school d^mistry tl^ topic of acids, base^ and pH is particularly challenging Ixxrause 
nAust understanding of the topic depemls heavily on the stisdent possessing deep concepts of atoms, 
irotecuk^ ions, a.x. diemical reiKrtiom* Deep corerepts are oj^raticmally defined in this study as 
omcepts composed of propc^tional networks which are hierarchically organized, differentiated into 
branchii^ subooncepts called mxies, and integrated by linking to otl^ comr^pts (Novak and Gowin, 
1^}. A robu^ uraieistanding is attained when a student has a propositional network which is 
suffictentfy deep to altow the stu<fent te explain oteerm) j^ieiK)nriena and to predict tl^ behavior of 
new piteimiena. 

The student must also be able to represent this rertwork of information, which we call knowledge, in 
one w more ^ the representational ^rstems used in dentistry to organize and display cl^mical 
kiwwtedge (Nakhleh, in rcvtew). In chemistry four intotronnected representational ^tems arc used: 
the macroscopic sy^n in wluch matta- has bulk puperties, sinrh as pH; the miaoscopic system in 
which matter is regarded as being composed of nwving atoms, nralecules, and ions; the embolic system 
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in whkh matter asKl dionical rracticms are symbolized by equatk)ra, diagrum, aiui nwle^^ 
diawii^' and the algetedc ^stem in which (he rdationshins of mattor are presented and 
manifHilated using framuks ami grapl^ (Gabd, Samud & Hunn^ And^sson, 1986; Ben-Zvi, Eyion 
& SIberslein, 1988; Yarrodt, 1^; Hermn, 1983). Kra|dk (19$>0) refers to these interconnected 
representatkmal systems as "integrated under^andings." A student must constantly sMt betM^en these 
r epniwu rtatfonal sy^ms, em^knying each at apf»t)p/iate tintes, when he or she engages in dwmical 
reasming about addsand bases. 

hi tiie study of adds and l»se^ the miooscofnc represaitation system is used in describing the 
fundamoital model of the kinetic and particulate nature of matter, and the symbolic representation 
system is used in working with the equatkms whidi d^cribe diemical behavior. For example, in the 
&«i$ted-Lo«ny nuxlel adds are ddined as »il»tarK£s which contribute an ion to an aqueous 
solution. Theref(»e stwiaite mtst ha^« some umierstamiing that an ion is a anall, charged, mobile 
part^ which can be produced by tiie disa>ciation of a saibstaiKe in aqueous sduticms. Hiis dissociation 
pnxe^ can be represented symbdikally by an equation, sudi as 

"^(aq) "*(aq) * °"(aq)- 

T)« sdentists' model of the particulate nature of matter is described in terms erf atoms, molecules, 
and kms, BXtd these topes are taught in the beginning of the course am! used throug}K>ut the year. 
Chemical eqi»tions syn^Iize the dynamic and interactive nature of the particulate model and are 
also taught throughout the course. So in a r^l sense the ^dents' undCTStamlings of adds, l»ses, and 
pH accuratdy reflect how well th^ have internalized and integrated a basic unda^tanding of ihe 
particulate, kinetic nature of matter. 

We^ I^nsham, and Garrard (1^) a^ert that students have access to varied sources of 
fnfomration; formal instruction in chemistry, public knowledge as available in various media, prior 
knowledge of sdence in ^neral, and practical experiences in usng oonuncrdal poducts. Knowledge is 
also acquired in informal situations, such as information acquired from parents and friends. . udents of 
dten^^ are constantly ei^ged in a process of turning this hifomiaticm into structured km>wledge, and 
dUs pnx^ seems to be a difficult cme for the majority of ^udents. 
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As students struggle to organize this omstant flow of information, Wittrock (1986, 19^, 1974) e yi 
Osbome and Wittrock 09S3) that students generate knowtedge structures whidi niay be exploded 
and described various techniques. FosnerandGertzogd^) use dinical interviews to probe 
stuiknts* knowIe(%e of particular concepts^ and Larkin and Rainard (1984) and Krajdk, Simmons, 
Lunetta (1^) argue that thihk-aloud protoccds are a sensitive method of expkiring students* proUem 
scivii^ teduiiqi^ Novak and Gowin (1984) advocate u^i^ ocmcei^ maps to display, evaluate, axd 
detect changes in students' knowledge structures. These knowledge structures are dynamic in that they 
omstaiUly chai^ by incca'poratii^ infonnatkm m* deletii^ old inftmi^tion, and sometiix^ they 
dtai^ in unexpected ami inappropriate ways. C^bcm^ and Freyberg (1^) pr^ent evidence from a 
serfes of studies in New Zealand's Learning in Science Project to show that students* prior knowledge of 
a science ta^ and ^ir e^^ryday rraanings for comnwn Kience terms strongly influence, even hinder, 
ti« Ie»iung whid) occurs in the sdence da^room. 

Some studKS suggest that microcomputers used as data collection instrun^ts have the potmtial to 
allow stiKients to develop cteeper and more detailed sdence concepts (Kra|cik, 19%; Linn, 1^7; Uiui & 
Songer, 1988). The mechanism by whidi this apf»rent enhancement of le: Tting functions is still being 
investigated, although both the computer's interactive nature and its immediate visual feedback have 
both been offered as initia] hypotheses (Unn & Songer, 19^). 

lovowledge is acquired imd stored in a dynamic ^ructure, it was vaiuatne in this study to 
investigate how knowledge changed as a result of the student's exposure to a particular type of learning 
task. Two areas of interest were targeted: the change in the students' understanding of acids, bases, and 
pH over the course of treatnv?nt and the type of t}tt>ught processes in which the students engaged 
while performing the treatmen'. tasks. These understandings and thought processes were followed as a 
functiim of three levels of infoimation prraented by the technology, low level as repr.'sented by the use 
of chemical indicator solutions, intermediate level as represented by the use of a pH meter, and high 
levs^ as r^ire9»ited by (he use of a microa}mputer-interfaced electronic pH f»t>be. In this paper, we 
r^rt on studoits' understanding prior to and after interacting with these tediTH>k^es. 
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Students were grouped by the level of technology emptoyed. Each group po-fomied the same 
seqiKnoectf titratk»»ofUireediflerE»Uaddsbyabase. Treatn^t group 1 used a chemical indicatt>r to 
detect dianges in pR IVeatmoitgnnip 2 used a pH meter to detect changes in pH and treatmoit group 3 
used a ntoooon^ter to detect chaises in pH. Within e^ treatment tlw sales of titrations consisted 
of a strong add-strong base titration, a weak add-strm^g base titration, and a polyprotic add-strong 
base titiatimv Hydrodilorte add (HQ) was used for the strm^ add, and acetic add (CH3CHOOH} 
was used for tiie weak i^-strong base titration. The pc^rprotic add was phosji^ric add QisS04). 
In an erf tiw tltrattons sodiimi hydroxide (NaOH) was die base, and all onKrraibBtions viere 0.1 M. 
Chaises in the understanding of the students were eqdored by using the verbal data and drawings 
olHaii^ in p« and po s ttre a tn ^ nt semi-structured intervtews to consttuct conc^t maps and to estinnate 
the depth erf fheir molecular ocmcepts. We rqx>rt chaises in concepts of ackls, bas», and pH as 
evidowed by the concept maps of t)« soni^trwiured interviews. 

Hftem senior high sdKwl ^udents in grade 11 who comj^^ a regi^ fixsn-yeaT chenustry course 
took part in tiiesttKfy. The shKients wne sekcted tl^ nwthod of purpos^l samj^ing (Bogden & 
Bikten, 1962) in which partidpants in a study are dv^n in order to fadlitate ihe expansion of the 
dev^>ping theory. Bogden aiKl Biklen argue that this samj^ing method is applicable in research 
designs whkh are imlucti^, tl»t is, which look at many pieces of data ami try to find common patterns 
(ff thoQKs in the data. We Mq>ected that students who have fragn^ted or inconrect coiuepts of adds, 
l»ses> ami pH vvDuId devek)p nwre integrated c on cepts over the period of the treatrrent. Thisn^ant 
that very high achieving and very low achieving students were exduded from the study. High 
achievii^ students might ^ready posses fidly develqsed and well-int^rated roncep^ and lower 
adii^ving studeiUs might r^ have enou^ of a conceptu^ base to build upon. Therefore, we dedded to 
select students who had an overall grade point average (CPA) of 2.80 to 3,20 or who had earned a 
cumulative d«mistry grade of B- to 6^. The students in the fitsmple also reflected the ethnic diver^ty 
of the school: African-American, Asian-American, Caucasian, and Hispanic. We divided the students 
into tluee trratment groups by sex, class period, ar^i CPA in an attempt to provide simikr groups. 
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The data were collected in the last two months of the school year, so die students had essentiaUy 
comf^ted their unit on ackl'^asedientfstry. Tlw study was conducted in a suburban four-year high 
kImx)! an die east coast which smed nine communities with a population of 150,000. The population 
ranged in sodo-economic status from lower middle class to upper middle da^ The sdK>ol enrolled 
ipptondaatEiy 1800 stiKloit^ and of dtese students dightly tess than half compteted a col . ge 
admtesioxttfH?og;fam of study. 

TVsfripHon nf tf>g Sfml-stnirtnrpd Intervlgws 

The pretreatm^t sani-striKtured intoview consisted of an introducticm and four sequaices of 
exan^les ami demon^rations. Spedtic questions in eadi section v^re astod of all the students, and 
foltowb^ qiK^ion dwre were two to three levds mbqt^^ons whidi could be used to prc^ 
furtl^ if stwiente nwntioned these topics or torrs. For ocample, if a ^tidoit stated that an add could 
i^tralize a base* t)« researcher would respond "You n^ntioned d« term rautraUzation. What does 
that term nwan to your Ths rrararcher was also free to prc^ student respond that did not fall into 
the preset categories^ but hi all cases the researcher asked every student the same fundamental set of 
({uestkutf. Interviews were audiotaped and ami trar^cribed. 

The pt^ttrratiT^t semi-structured intervkw was a parallel form in which the examjdes were 
chai^ged and tlw fourth %quence was reversed so that the add was added to the base. 

Rrst sequence . The student was ^wn a small bottle marked dilute add, dilute base, pH 4, and pH 
11 respectively. In each case the student was asked to tell what he or she knew about adds, base^ or 
pH reflectively. Since the j^lot study h»i reveled possaUe weak conceptions of irolecules, atoms, 
and kms, each ^ixlem was adced to draw on the interview data slwet what th^ nUght have seen if 
tl^ a>uld have kwked through a very fxnvCTful magnifying glass at the solutions of adds, ba%^ pH 4, 
andpHll. 

Secotkl sequence . The student %vas stown five labelled bottles or cans of ammcmia, vii^ar, 
di^wm^Kii^ delei^t, baking powder, aiKi Coca-Cola.The student was tl^ asked which of tl^se 
poducts n^^t contain an add. Each setection was fhm discu^ed as to why it was an add. Then the 
studmt was asked to select any bases which might be jMiesent, and tlw reasons for each selection were 
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discoised. The next section this seqmiKe vvas a i»«$entation <tf five small bottles labdted with the 
fonnaks HO, NaOH, CH3COOH, NH3, and Nad, which rei»«senl hydrochloric add, sodium 
hydroxide, acetic add, ammonia, and sodium diknide req)ectiveiy. The sttxient %va5 asked to sdect 
whidimes «rae acids> then tiw rrasora fir tiie setectitm wm discusi^. Finally, tiis tmident was 
asked to select whidt of ihe bottles labeled witft formulas were bases, di^ssii^ ihe reason for ^ch 
selvctkm. 

TIrird sequence . Students obser*^ th.? d«nges that occurred when the add and the base were 
mixed tt^etl^. The student was ^wn the bottle marked dilute Kid ami ibe bottle marked dilute 
base. About 50 mL (tf die add was poured into a beal^, and the student was told that some 
phsm^ltthaldn w>uld be added. The studoit was then asked to state what they knew about 
phenolphtb-»!ein- If they were uncertai'i, the first response was to state that phenolphthalein was an 
acid/boK indicator. The sti«ient was tha\ adced to tell what th^ ki^w about add/base indicators. If 
the student was still unsure, the final statement was that the phenolphthalein would change color if 
any chai^ occurred in the solutton. Two drops of pl^K>lphOutein were added to ihs »ad in the 
beaker. Then the base was ^wly added to the add, stopping to swirl the liquid in ihe beaker so that 
the student could see the pink color form and then fade before changing permanently to pink. The 
student was then asked to describe what had ha]^>ened to ihs ackl, to the base, and to the pH. 
Finally, the student was asked to state what they thought was in the beaker after all of the base had 
been added. At the end of this section students were also asked what they would see if they looked in 
the beaker with th^ powerful magnifying glass. 

Fourth sequciKg. Students were presented with two possible graphs, on separate sl^s of paper, of 
pH versus rolume of base added and M^re adced to select which graph best described what had 
happened to tl« pH when the base was added to the beaker. The grains were presented at the same 
tin« and in ^ same order to each student. Also each student was told again ^t the add was in the 
beaker and ihe base was added to t}« add. The graph the student selected as correct was marked #1, 
«id d» otfier graph was mariied #2 and laid to one side. The student was then asked why he/^ had 
pidied the #1 graph. Next the student was first asked to drde and label it)e part of the graph that 
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showed the system was s^dic^ thoi tiie part that was basic and last the part that was neutral* 
HnaOy, rhe stiKlenfs attention was drown to tte steep vertk^l rise in the grap't where the add and 
base ra{^y ami a)m]:^ete}y diange to water am) a salt, vrHdt nratralizatkm. The student was 
asked to explain what they thou^t was happenii^ in this vertical regton. In tiw la^ section of this 
sequence the studart was shown the g;re}^ mailed #2 which the ^udent said did not descr&e what 
he/shesawhappeninginthebeakerasthebase was added to the add The student was asked what 
this grajf^ did describe, 
fapntlntggim 

In Older to have a stamiard a^irst which to compare ^ students' interviews and to provide sonx^ 
estimate of validity for the iniervtews, four experts in the fidd I'l^re give t)^ same pretreatn^t or 
pc^trcatment interviews as the students. Of tiie four w1k> M^re intervtewed, two I^id the Doctor of 
Iliilosophy in Sd&ice Educatkm with expertise in chemical education, oro was finishing a Master's in 
Scteim Educaticm, and oi^ l^ld a Doctor of Hiilosc^hy in Chranistiy. Two experts recdved the 
l^eueatn^t interview, ami two received the pc^treatn^t interview. All of tl^ ^cperts stated that 
the interview ^ectively covered the important topics in undergraduate le^^l acki/base chemistry. 
Analysis of the Intgrvigfvs 

The iniervtews were analysed by concejA mapping. Ccmcept maf^tng was selected as tiie most 
sensitive tool to detect ^fts in uiulerstai^ing from pretrEatment to posttreatn^t A sense of the 
magnitiKie and directk)n of the change could also be c^tais^ by scoring tl^ maps aiKi coinparing the 
gain scores to post for ^ch stiKient aiKl by comparing tl^ average gain scotk treatment 
groups. The students' drawings assoc^ted with tl^ interviews w^ used to clarify and confirm the 
propc^tions extracted from the interviews. 

Analy^ erf Cwicept Map s. In order to construct meanir^fulcoiKept maps of sudh a oh^ 
M knowled^ <rf ackis, bases, aiKi pH decision rules had to be constructed and strictly followed. Initial 
attmipts at mapf»i^ quickly made it clear that one single comrept map eiKCHnpa^ing the three basic 
concepts of adds^ bases, and pH would be difficult to interj^iet Therefore it was dedded to break the 
interview concept ma|^ into three separate maps^ or^ for adds^ one for bases, and ons for pH. This 
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meant that six concept maps, three pretreatment maps and three posttrratn^t maps, were pepared 
for each stiidenL 

These ttiree major divisions of the concept map followed the ^nicture of the interview very 
naturalfy, whkh made it fahly easy to om^nict the maps. interview had sectk>ns describing 
^ds and selecting examfto of adds, describing bases ami sdet^ng examf^ of bases, and describing 
pH and tiie interrdstiwiships between adds ami bases as expressed in the neutralization reaction. The 
appopvkite sections were used to coi^truct map. 

Selecting Propositions. Eaxih interview %v» re«l aikl statonents ami f^uasra which revealed the 
student's prop(»itional kiwwtedge about eitho* add^ bases, or pH were selected. For example, 
statem^ts which contain {^uases such as "adds are. . or " I believe that . . would be selected. 
Huse propositicms were i»ed to draw tl« actual cofKspt maps. T}% student's ecactwordii^ was used 
wl^never possible in order to closely conform to the statements made in the interview. A record was 
of eadi ded^on rule that was made to maintain consistency in map construction. 

However, three gei«ral exceptions wwe made to this rule of using the student's own words. First, 
examples that the student gave, sud) as lemon juice is an add', were drawn by connecting the concept 
labels 'Adds' and lemon juice' and using the word 'as' on the connecting line to denote that the 
idaticmship being shown was that of an example oi an acid. On a omcefH map, tl^ statement would 
read ' Acids as lemon juice." All examples were treated in this manner. Second, the concept map of the 
pH graph was always connected to the overall pH concept map by the proposition "pH can be shown as 
pH graphs." Third, the |»t>po^tions "pH graphs jjli^ Adds ...," "pH graphs place Bases....," and "pH 
graphs pliKre neutral.^." were generally used to indicate the location of these areas on the students' 
graphs. This provided a standardized method of handling the examples provided in the interview 
and also provided a standard way of linking the pH graph dlsois^on into the pH concept map. 

See Rgure 2 and Figure 2 for examples ctf conc^t maps. Adds, pH, ami bases are always emrlosed in 
an irregular shape in order to clearly mark them as one of the three mapr concepts. Any link between 
add and base, Kid and pH, or base and pH is a cn>ss link between two different areas of km>wled^. 
Nodes which are repeated acro» n^ps for one interview are in a rectangular shape. 
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[Ireert Bgur» 1 ami 2 about l^ne.] 
Ma ppii^ Examples. Arerther dedrion nile had to be imf^emented in regaid to exam 
interviews contained two types of examines: examples ^xmtaneously generated by the stiident and 
examples %vhich were presented to the student during the interview. Examples presented in the 
interviews were to be drawn from tite label "Adds" to the example and then the example could refer 
bade to the qpedfic dtemical or j^y^cal property whidi had prompted the selection. As an example, 
astudo^s^oposttionthat 'amnwnia is an add because it is stnmgf%vould be graphed as 'Adds igS 
anunonia because it is strox^, which would be a r^mnce to ths concept label "stror 3" which would 
alrrady be pesent on the nnap in son% proportion such as "Adds as strong." (See Figure 1 for an 
illustration.) This was done in order to help Identify what were the nodes or concept labels in the 
stucknf s umtostanding to whidi he or she constantly referred when nnaking decisions about what 
constituted an Kid or a base. At a lato- stq> in the analya^ tl^se nodes were denoted as critical nodes 
and weie used to looli for shifts in urufer^anding ami (of (xmnvm pattens widiin groups. 

Exarn]^ whkh were geiwrated spontaiwoudy were mapped from tto qjedHc diemical or 
physical (ffoperty whidi had gmerated the example. For examf^, a student's proposition that "Adds 
taste sour, Hkt pickles!* would be mapped as * Adds taste s our as pickles." The word "picWcs" would 
itot be gently refer^tKed by any other propc^tion. Figure 1 provides a concept map which contains 
both types ctf exampie& 

Sflatog flic Cffnffpt Maps 

Propositions and Examples . 11« ccmipleted coiKept maf» wer? scored ^xordii^ to a comnwn 
algorithm presented in Novak and Go win (1984). All acceptable propositional relationships which 
did not involve cross linking were assigned a point value of one. Also all acceptable examples were 
aSRgned a vaUxie ^ one. If an example was judged unacceptable, but its sutoequent proportions were 
acceptd^ then those subsequent prqior tions were not counted toward the total map score. 

OpssLinks> . A cross link was coi»idered an impcmant indicator of integrated, nr^ningful teaming, 
and spedltc rules were developed as to what should count as a cross link and what should not. A cross 
link ootUd have occurred in one of tvra ways. First a sttxient «>uki have related two different nodes. 
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ccm)ingfrcmitwociilfei«ntlb^09ttt«cc»^ I^r example, a studmt could have stated that adds 

aie strong and 0^ also have stated diatiKidsneut]^ Figure 1 gives an 

example ctfsiKii a cross link. Hoivever, the Unk betweo) an exampte ami an acc^tabfe reason for 
selecting tiiat example did not count as a aom link. 

Inaseccmdtypeofcn^link^asttklottcmildhave invcd^edacw^tkmbetween two of the three 
major ocmcepts irf the snap, swh as making a ^tsi^t that adds i^utralize basK^ which imiicated 
that ti« student was a»mecting two ^ibstantiaUyc^^ Figurelalso 
gives »i examine of this type erf at^ link. 

Because a ax^ link indicated knowledge integration^ an iKxeptable cro^ link was scored at 10 
points. Novak and Ck>win (1^, page 107) state that ''CfX>ss links that show valid relationships 
between two distinct segments oi ihe ccmcqH hierarchy signal po^ldy important integrative 
recondliaticmsw . . ."^ He also recom^nemis that linkages^ ^ch as crtm litiks, which signal integrative 
rcoondliation be assigned a score value betwem 10 ai^ 20 tin^ the score value of a valkl relationship. 
Thereftm a score vali^ erf 10 p(^ts for a cn>» Hnk does not serani un^ 

Meaningful, integmied teamii^ as evidenced by cro^inking, r^ted in a substantial difference 
between ti^ pretieatment md posttr»t-mnt concept map scores. Because the ooss links were important 
to the analysis a detailed set of rules was developed as to what counted as an acceptable cross link and 
what did i»t count For example, a cross link had to occur in different lines of descent from the n^in 
conoept and could tyox occur between an example md a reascm tte example was selected. Figure 1 shows 
an examj^ of croi» linkb^ 

HieniTghv, Many coiKept map scoring schen^ indude a score for acceptable levels of hierarchy 
present in the map. Typically this score is five points for each acceptable level (Novak and Gowin, 
1^; Wall^ and Mintz:^, 1990). Hoivever, in studies wJ^x^ hierarchy is scored, shjdmts ha\c drawn 
their own concq>t nuj^ after having been trair^ to do so by tl^ researcher. In that situation, the 
hierarchies on tl^ maps are a valid reflection of tl^ stiklenfs actual understarnjing. In this study, the 
concept maps were drawn by ti^ researcher using tl^ interview data, and it was decided that 
hierarchies could not be validly inferred from the interview data. 
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Scoring the maps . The total score Jbr each concept map was obtained by adding aU 
each sectkm^ the ma^. Ea(^ section of the map was cross<hedced by the researcher to niake sure that 
soDK cross folks %v«reiK>t counted twice. Fnr example, in discussing adds a stiKiett could say that adds 
neutraUzebaseSy and then in discussing beses the student could turn the rtatement an>und and state that 
bases neutraliie ackls. Both of these statements are accessing the same parts of the student's 
nndefstandii^ and dx>uidcmfy be counted oras. F^;urel8isanexamptectfahi^scorii^map,ami 
RgureSisanexan^ofalowsooringmap. F%;ure7isanexan^ofamedium8coringmap. 

In addition, a total score of unacceptaUe relatk>ns in each ccmcept nnap was obtained using the same 
so(»ing procedure. Thb was done in orde- to estimate unacceptable changes that could have occurred in 
stucknts' understandings over the course of the tn^tme^ts. 

Reliabimy of Concept Maps. A Ph. D. in science education with spedalized preparation in 
choni^y was trained by the researd^ to construd and srore coiKept maps in order to calculate an 
inteiTatar reliaHlity. The rater was trained i^ng two concept maps dtosen randomly, and the rater 
was pTDvided with a written li^ of the dedsion rules which guided the creation of the original maps. 
Then the rater constructed tfiree randomly ^cted concept naps, and a reliability of 0.82 was 
calculated by dividing ibs number of agreed upon nodes by the total nun^jer of nodes on tie original 
mapi The rater then scored three randonUy selected maps, and an interra^ reliability of 0.83 was 
cakulated 1^ dividii^ ^ total number of agreed upon relatk>nshi}» by the total nun^)er of 
relattorerfiips on the original map. 
rimstmrtkm and Use of Earprrts' Concept Maps 

The intoview transcripts of the chemical experts were reviewed, and concept maps of their 
uncterAandii^ were drawn aiK) scored. The expol map scores were used in two ways. Fir^, the exp^' 
scores were very similar, with an average of 157 points. This iiuiicated that the interview scripts were 
rdiaUe and gave consistent scores. Second, tlw maps were examined to identify tlte critical nodes 
whidi were referenced most frequently by the experts in explaining their knowledge during the 
faitervtew. Tliese critical nodes were then used to assess the students' critical nodes to see if their 
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thinking had shifted toward the understanding of an expert. Wallace and Mintzes (1990) used the 
notion of critical concepts in a ^milar nuiuter. 

Critical nodes are defined as nodes annmd which knowledge appears to be oiganized. We 
operatifnialized defined critical nodes as nodes which were refeenced by relationship lines coming into 
the nodes at least ttiree times. This meant that the student or expert had to reference that node with at 
least two cn»5 links in the intmiew. Relationship lines ^ing out the node to otl^ nodes were not 
counted in this process because outgoing lines do not indicate integrative thinking. A further restriction 
on a critical node was that 50% of the lines coming into the node had to expre^ an acceptable 
relation^ip to other parts of the map. 
Rpsalts and Analysis 

Equivalence of the TreatmCTt Group s. We examined the treatment groups for any differences in group 
compo^tion which might bias the findings. We found Uiree indicators which support the claim that 
tlw groups were rrasonably equivalent before treatment. Brst, the grouf» were equivalent on GPA and 
gender. Second, at the end of the year ^dents were administered a county ch^stiy examination 
which covered the major topics of the year's course in chemistry. The average scores of the groups on 
this examination were equivalent. Third, the concept map scores for pretreatment interviews of the 
three groups were again reasonably equivalent, although the pH meter group scored somewhat lower 
than the other two groups. 

Concept Map Scores of Acceptable Relati ons and Cross Unks. Table 1 presents the concept map scores in 
two ways: unweighted relationshif^, in which all valid relationships are scored as one point, and 
wdghted relationships, in which all valid relationships are scored as one point and all valid cross 
links are scored as 10 points. All groups show some positive gain in their concept map scores. Table 1 
indicates that the miaocomputCT group shows more change than t ie other grouj». The pH meter group 
showed the anallest differeiKe, a 16% increase in the wei^ted concept map scores from pretreatment 
to pc«ttreatment, while the microcomputer group experienced the greatest change, a 63% increase in the 
weighted score. The chemical indicator group registered a 38% change in the weighted scores. Looking 
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at the ^udents across groups* twelve of the stxidents evidence positive change in the m&p scores; two 
stw^ts had 9coi& which changed in a migative direction. 

{Insert Table 1 about here.] 

Concept Map Enflppl*^ 

pH meter group. Figures 2 and 3 illu^te a change representative of the pH meter group in the 
add concept from p ret rea t m em to posttreatment for student #0206.DC. Figure2alsoiUu^tesanap 
that received a reiativdly low score because mt^t of ihe relation^p are liittar and only a few cross 
links exist. 

{Insert Figure 3 about here.) 
The pH meter group had the teistchai^ in concept map scores. The number of acceptable 
relationships and examples for this student increased from 21 to 23, and the number of acceptable cross 
links increased from t^vo to three. In tiie pretreatn«nt map the map shows acceptable cross links from 
adds to pH and from pH to strength. The posttrealment map contains a new, correct concept that adds 
xe^ with bases* but the map also indicates that the produd is a mixture rather than two new 
ocm^pounds. 

These maps also sihow tl« persistemre of some unacceptable concepts. The pretreatmCTit map shows 
a proportion that M:ids are made of nwlecules and contains five branches which differentiate this 
proportion furti^. This was not accepted as a valid popxxsition because add solutions 
characteristically contain a mixture of ions and molecules. Strong adds are completely ionized and 
have no molecules in solution, and w^k adds have only a few ions are) many molecules in the solution. 
The posttrratment map stiU contains proposition that adds are made of molecule and a two-level 
hierarchy has developed to explain this proper* tion further. 

Ctonical iraiicatDr group, i^res 4 and 5 contain pretreatment ;ind posttreatment add concept 
maps for #0103.CF which are representative of this group. The number of acceptable relationships and 
examptes increases from 17 to 23 and the number of cro» links decr^ses sli^tly from five to four. Both 
maj» have acc^)^te cro» links between adds, bases, aiKl pH; however, the acceptable proposition 
that acids contain hydrc^n does not appear until the posttreatment map. 
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(b^ert Figures 4 and 5 idxmt here.] 
The pretreatment map shows that substances were idsitified as ackls on the basis of their 
harmful ness because the Coca Cola, vinegar, and ammonia are linked to the term hamnfuL The 
posttreatment map shows a shuc toward identifying substances on the basis of the hydrogen they 
omtain, as for exan^e HNO3 and H2SO4. Note, howevo*, that NH3 ai^ Ba(CHi}2 are ^so identified 
as «:kls usii^ this rule; therefore, the ^denf s differmtiatkm ol this rule is incon^ete. 

Micio«MT>putar group. Rgures 6 and 7 contain the pretreatment and po s ttre a tu ^ t add concept maps 
for #0302. WC which are representative of this group. The number of accejMable relationships and 
exan^iesincrea^fnmi22to24,ai^tl«nund>CTofcrDSslinlcsim3'easesfttmionetos^ The 
j^ietreatment map shov/s several actsptable example arel there is oi» acceptable cross link that adds 
interact with bases. The posttreatment map luis about ihs same numbo* of «x?eptable example and 
relaticmshipsy but the number of aco^Ttable cnss links has risen. Cross links occur b^ween adds and 
bases, between hydrogen ion and hydrogm, between elements ami baseSr between pieces and elements, 
between bases and p}«iK>l}^thaleiiv and between oxygen and h)^rc^en. These cross links could signal 
important integrations of concq^ts. 

(Insert Figures 6 ami 7 about here.l 

Thew maps also Ulustrate a pra^tent altenratira concq>tion this student Iwlds about bubbles. The 
prebeatment map shows that bul^Mes are a^ociated with baking powder ami Coca Cola, both of which 
the student gives as examples of adds. The posttreatn^t "^^p contains a ]:»x)po^tion that adds 
con^ bubbles and tiuit these bubbles are made of molecules ami iom. 

The maps also show a positive comrepttial change in that the role of hydrogen is more emphasized 
in fhe posttreatn^t map than in ths pretreatment map. Tl^ posttreatment map aho sh>ws a shift 
from a molecular representation of adds toward a nrK>re acceptable proposition that the n.olecule5 are 
lHt>ken into anallo* pieces which have a plus chaige, as the hydrogen ion. There is also a otKS link 
matte between the hydrogen ion and the element hydro^n. Therefore this map shows a shift toward a 
more acceptaUe umlmtai^ing 0^ adds as con ;aining hydn^oi ions. 



Nakhleh/Krajdk Levds oS Information of IMfferent Technologtes Draft 
Er|c I () 



page 15 



Cbngept Map Scpies of Unacc eptable Retetims and Cross Unks. In order to gain a more accurate 
estimate of tiie tr^tn^nt effecte, error rates must also be taken into consideration because no 
instructional sequences were used in this study. Therefore students might generate many acceptable 
r^tionships and also might gei^erale many unaccepUble relationships. The concept maps were 
rescored using the unacxeptr.ble relationships and disre^rding the acceptaUe ones. These data are 
shown in Table 2. In this table a negative number signifies a reduction in the eirorson the concept map. 

{Insert Table 2 about herej 

These data show a different trend from the data in Table 1 . Here the chemical indicator group 
shows an average reduction in the weighted error score of 14%, while the microcomputer group had an 
avera^ increase in the weighted error score of 49%. The pH n^ter group experienced a more moderate 
average irurrease in the weighted oror score of 5%. 

Chemical indicator group. This group showed the greatest weighted error reduction of 14%. 
Within the group. Table 2 shows that one student, #0111.DH, had a slightly increased error score due to 
cross linking, but the other group numbers showed a decline in unacceptable linkages. 

Figures 8 and 9 di^lay tl^ jnetr^tment and posttreatment maps of the base concept of student 
#0114.TH whidi are r ep re sen tative of this group. The maps show a^^Troximately the same number of 
rdationdups, but ihe pn>ponk>n of unacoq>table linkages (tedines from 15 lo nine. The posttreatment 
map also contains c^r jHopc^itions that bases can react with adds and that bases have a pH, which 
are impcnlant and appropriate cross links. However, the ^udent has also inoeased inappropriate cross 
links to stroigth, which indioit^ an increased belief that adds generally have le^ strei^th than 
bases. These maps illustrate the point that a simp>le reduction in the nu]id>er of incorrect relations may 
also be accompanied by an increase in inappropriate cross links. In summary, the maps show that this 
student decreased the number of his or her overall misunderstandings but that he or she strengthened 
an alternative conception about strength. 

llrisert Figures 8 and 9 about here.] 

pH meter group. Table 2 indicates that students within the pH meter group exhibit some variation 
in error patterns. On the wei^ted scores, the group increased its error score by about 5%, with two 
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^wlentsshowix^anbKT^useand twoshKl^tssto On unwanted scores^ the eror 

score (teclined 8%, Bg^ n wi th tl^ two stuctents showing an increise ami two stiuients show^ a 
ctecline. 

Figures 10 and 11 dis^^y tte {^etmtn^t ami pmttreatment maps of studoit #O^DR, 
representative of thte group, wIk> decUi^ in unwdg^ted rdatk»rvships tnit iiKrrased in the wei^ted 
crosslinks. The piietreatn»tvt niap veiy linear and undilferentk 

inapprof^te axm links to Mads. The pc^ttreatment map oontaiiu^ ap]MOximately the aanw number ctf 
ina|^|»opriate relations, but tl« nund)ar of inai^m>]:»iale cross links has doubled to four. The 
pc^ttrratment shows nK)re integra^n and differentiation, as evidmred by cross linking and brandling, 
around U« concepts ctfstrei^th,harnifubi«ssi, ami minder of ete^ Insum^ihis 
^dent seems to have solidifted his or her under^aiulii^ of bc^es aioimd a nund?er of alternative 
co n o gp t io n s . 

fln^rt HgurK 10 ami 11 about heTe^ 

Micj pffymp yitff y grpup. This group had tl^ g^test increase in error scwe of all t}« groups. Their 
average unweighted increase was 24%, and their av^age weighted increase was 49%. This indicates 
tiiat they formed a number of inapp^priate relations and cro» links. Howev^, this group also 
ii^reased &)st aoceptalde weighted score by 63%. This indicates that they formed many ai^>ropriate 
relatfons and cross links as well as inapprofmate ones. The miooccmtputer group shows evidmre of 
high ei^genmt in tl^ MBL activity ami basically needs ii^truction to channel this engaged thinking 
in an acceptaUe direction. 

Rgures 12 and 13 Qhistrate this point l^se pretreatn^t and posttreatmestt l^se concq>t mstips of 
mident #0312NM, representative of this group, i^w that t)^ total niunber of relationdiips doubled 
from ptetreatn^nt to posttrBbtn^t. Also (he postti^tn^t n^p ccmtains rm>re traiKl^ and cross 
finks* The pretreatn»it map contahis cn^ aj^>ro}»1ate ooss link to acids and two inappropriate cross 
links to hydrc^en. Hoi^ver, tl^ postti^tn»it map contains ^ appropriate cross links between bases 
and pH. between pH aiul Kids^ between equations and OH between ratio and oth^ elen«nts^ between 
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Ba(0H}2 ami pH 10, and betiveen plus and attraction. The posttreatment map also contains more 

insjppnpti&ts r^tiom and cross links. 

Iln^ Fl<nires 12 and 13 about here.] 

The maps also show that tiie mutenf s molecular ]m>po^ti{»» chan^ in an approjniate direction. 
The pretreatment map tmly references the general term "elements", but the posttreatment map shows a 
srore dearly defined subset of proposition attached to the term OH whidi recognize that Ae OH and 
H have negative and positive diai^es. 

rrirtcal Nodcii on fi\e Concept Maps 

ThecoiKe|4ma{»of Ute experts were used to detomiiw die critical m)desarouiK! whidi experts 

appear to organize tl^ krM^wtedge. Figure 14 slwws tl^t this experX oiganized his or her kiv)wtedge 
of %kls around ti« »>des for hydroniun tons, strong adds, anions aivl nK^tecules. All (tf tl« critical 
noctes for the eiqperts were identic arid six nodes wn«importot in evoy experts' map: H'*'ions, 
water, ioi», neutral, sohitk>ns, and concenb-atkm. Th^ ^ woe then considoned to be central to a 
nKcessliil understamling of add/l»se dmni^. For the sake of l»evity, the six critical nodes of H^ 
tons, water, OH" ions, neutral, soluttons, and concentratton which vme identified in the experts' 
cono^ maps %viQ be referred to as expol aritiail nodes. 

llns^ Figure 14 about l^e.] 
^udents' maps %vere Qtean examined to identify the acceptaUe critical mxies around whidi tl^ir 
knowledge appeared to be (M^ni^ and to ascertain if any tiiem wen u^ng expert critical mxies. 
Tal^ 3, 4, and 5 indicate the number of acceptable critical m>des which where identified in the 
^(tolls' prretrratment and posttreatn»nt ctnKq^t maps. A pattern emeiges which is similar to the 
pattern of titeoonccpt map K^Tres. The microcomputer group expnlencedtl^gr^te^imTe^. TY^ 
rtu d enb * critical nodes were also compared to Hbe ecperts' critical iKKles. If students u^ the same 
critical iK>des as did the expels, that iu)de is starred in Tables 3, 4, ami 5. 

{Insert Tables 3, 4, and 5 about here.] 
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In ttie diemical indicator group the ninrd^CT of expert critical nodes is reduced by one from 
preUe a tment to pc^ttcatmotL Hgures 15 and 16 iUi^trate ^ pc^t In Figure 15, which is the 
pretreatment add concq?t map, ^ student used hydrogra kms as a critical node. This is also an expert 
critical nocte. !n the posltreatm e nt map stown in Bgujie 16, however, this expat critical node has 
vanidied^aiKl the posttaeatxrant map shows that kra>wtedge is c»'gani:Kd arcmnd hannfulnei^and 
hydn^en, botii of which have inappitq»1ate relations coming into the node. 

[b^at Figures 15 aid 16 about Yare.) 

In the pH meter group the number of expert critical nodes increases by one, and in the microcomputer 
group die aitoJm)desfav3ease 1^2. Howevnr, tl« importance of these critiail iK>des can be more 
accuiat^ gauged if die number (4 tinws that th^ are r efe r en ced is also calculated. When this is done, 
a pattern similar to tlffi erne ra>ted before in t)« concept map scores «T«rges. The chemical indicator 
gnnip's nA g a we s to itsexpert critical nodes inaeaK by two, from 16 to 18 times. The pH meter group's 
r^emwes iiKiefl^ by four, from three to sev«) times, ^we^, dw microcomput^ group bKr^ses its 
r^erences to exp«t critical luxles by 18, fmm 18 to 36 times. 

T!« osttn^ between the pH meter group and d« micnxxm^ter group can be iUumatod by Figures 
17 and 18. Rgurel7sIv>wstteposttrratn«ntpHmapofastuda\tintl«pHn^^gn)up. Thismaphas 
only one critfesl ncxfe for neutral, whkh is also an expert critical node, and the critical mxie is accessed 
byamii^mumctf liras. On die otho'haml. Figure 18 shorn tl«pc»ttrBatn«ntpH map of a student in 
die mionocomputer group. This map contains crittoal nodes for hydrogen, i^itral, OH- ions, pH 7, and 
wa^ whkii have many appropria^ incomii^ lii%s and whidi are well-integrated into the student's 
knowlec%e structure. Also &e nodes for neutral, 0H-, and water are e?^>ert critical nodes i» well. 

[Iraert F^^res 17 ami 18 about here.] 

The same pattern iK>lds when number of tinws that the% iK>des vr&e refoienced is ralculated. The 
chemical tnliait(»' grocq;»'8 refioiMKes tiicrease by 36, from 36 to 72, and d« pH met^ group iraseases its 
references by 6, from 21 to 27. The microcMnputer group increases its referemss by 59, from 51 to 110. 
Again, the MBL activity appears to encourage students to engage in restructuring their chemical 
kiK>wtedge. 
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Hgui«s16w17,and ISagainUIustFatethbpo^t Figure 16 is an ackl concept map for a chemical 
buikatOT stiuio^ and it has no acoeptabte aitical mxtes. In addition, it di^Ia)^ a strong alternative 
conce^ionbidtt around hannftdness. Figure 17 is a pH<:omsiH map for a pHnwter student containing 
<»ityai«uoeplal^ critical no(te. Figure 18, however, is a pHonice]^ map da microcomputer stu<tent, 
and it is constrw:ted around sevend approf^te critica) nodes. Sorra inapprt^»iate links are made, 
e^jedally to the nod» for pown' and ^rei^th, Init generally this map shows a betto- integration of 
knowledge than the other two maps. 

Fnm c«r analysis (rfdwconc^tnuipsaiul drawings, we made two gei^ralcoralusio^ First, 
students using mkrocomputer-based laboratory activities appeared to construct mc»e povverfiil and more 
m^mii^ial diemical concepts. The posttreatn^t concept maps showed greater differentiation and 
integration of concepts. ]^ the ei^oltl«trratment, the ^udoits in this group expressed mc»ie 
accqitalde sabconcept nodes, linked these nodes tc^ther with more acceptable propositions, and built 
more cross finks betweoi ihax nodes. Hiey also built thdr maps around more accei^ble critical nodes, 
inchiding several expert critical nodes. Although Utese studente did exhibit weakness in thdr 
uiKJerstaiKimg;s of toiization aiui neutralization reactioiB, tl^r postti^atment kiH>wI«ige of adds, 
bases, and pH was was more detailed and more integrated than the knowledge of the other groups. We 
intCTpet t!us to mean that the micrcjomputer-based laboratories had a substantial influence oi> their 
uiKter^andii^ of ackl, ba%, and pH a»Kq7ts. 

Seomd, tfie micJOComp u tCT group's high ra^ of both enoraous and accejiHabte links provide 
evidanoe titat these students were pc^itivefy ei^a^ in restructuring their domical kiK)wled^. 
Students apparently construct more concepts using n^crocomputer-based labcM-atories, but careful 
analysis oi the kdx>ratory task, directed tiling, and class discu^ion are needed to counto-act the 
fonnatiaft (rf inappropriate concepts. For etample, extensive pre-laboratory discussitms omki be used to 
cleariy focus the stutfent's attention on what are the imp(»tant dues to observe as the laboratory 
pro g re ss e s, to cteaxly ^te the objectives of the experiment and to encourage the studoits to recall what 
ttiey know abcmt adds and bases and how Uuit knowled^ applies to the laboratory activity. Post-lab 
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discussons are necessary to uncover and confront alternative oonceptions which may arise during the 
csuise ol the activity and to remind the ^udeits of the ]Mirpose of Hhe Ubonta^ and to eiKOurage the 
imideiUs to n^te what they found in tiie laboratoiy activity to the cognitive knowledge taught in 
lecture. These instructkmal tactics allow the student to link tt^ther the various components of his or 
hn'undei^^andingsintoamoreod^rent whc^. 

Edacariimiil Slynlfifanrp nf Study 

MBL appean to hdp ^tuients <fev^>p deep»- understanding of adds^ baseSy and pH conc^:^, a 
ii«iicated by the amcepl maps 8ho%ving more cktailed difframtiatkm aiui integration. M6L also 
appears to be ^Fective in reir«diating studoits' wtak models of matter because tiie microcomputer group 
made the greatest positive shift in tl^ models, but tow this happens is not c^r. It nay be that the 
g^ph which 1» constantly displayed on the screen altows }he students to free their short-term 
iramor^ from the tnirden of proce^ng t)« infomuition prorated by tiie titration fmd allows tl^m 
Sufficient time to reflect on what might be Happening on the molecular level, to access their long-term 
memories, and to esentially restructure their information into t¥sw knowled^. It may also be that the 
visual image of the graph screen is suf^ently vivid to be retail^ as a strong ami easily retrievable 
tnexncry. 

Implications for Future Research. This study indicates that microcomputer-based laboratories can 
help MmteitsfonniobiKt understandings ctf Mid ami base conceits. Howev^, microcomputer-based 
laboratories seem to be a two-edged svmn} in that they focus attention so pow^fuUy ti^at students 
might eaaly and oithusiastkally cr^te inaj^»opriate understandings. Therefore research needs to be 
dime on e^ctive methods using microcomputer-based laboratori^ in teadting. For exam];de, the 
value of pre-laboratory and p(»t-laboratory discussiora as a means of identifying and confronting 
altemative cono^tioi^ iteeds to be examined. What is tlw appropriate role of a pre-laboratory 
dtecussion? What is die appropriate role of a post-laboratory discu^on? Are there commonalities in 
tiiese roles? 

More research ateo needs to be done on what attributes <^ MBL cause it to work so well, are! the 
suggestion that MBL might function as a auxiliary memory device for the student certainly needs 
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furtiier expbratum. Fbr example, what role does graphing Ihe data on t)« screen j^y m )«lping 
8tudatfsdtevdk}p more appropriate uiKlCT5tan<&i^? How are visasA ima^, mxh as graphs, stored in 
kn^tenn memory? How are visual images used in the integration of knowledge? 

This study also indicates that concept maf^ping may be a powerful and sen^tive technique for 
studyii^concephialchaf^. This use of concept ma|^9ing is rdativdy recent and ou^t to be expk>red 
further. 

This study also began to clarify what are students actually thinking about when they engage in a 
laboraioiy activity. A laboratory experin^t is a ctmiplex l^uning environn^t, and students may 
become so overwhelmed with the task at hand that they literally have no memory space left with 
which to tiiink conceptually. Much more work needs to be done on students' thoughts during a 
lalx>ratoiy activity. 
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Table 1 

Cmifiyt Map Sr«rP« irf Wrfglited and Dnwrighted Accgphibte RgUtkmshtoa bv TYeatment Group 



rretrwtmmt 

Unweighted Weighted 
Relations Gross Links 



Unweighted Weighted 
Relations Cro^Lb^ 



Chemical Indicator Group 

0103.CP 55 

Oin.DH 47 

0111.AC 29 

0113.S5 50 

0n4.TH 45 



167 
146 
29 
158 
-22 



Average 45 120 

Unwe^ted difference = 4l5 points or 4-33%. 
Wei^ted difference » ■f46 points or -f 38%. 



76 
68 
36 
63 
S2 

60 



211 
248 
54 
189 

166 



pH Meier Gnmp 

0204.sk 45 90 

0206. DG 41 104 

0207. CS 47 137 
0209.DR Ifi J5 

Average 38 94 

Un%yel^ted difference « ■4-5 points or 4-13%. 

Weighted diftoiem^ « •f15 points or 4-16%. 



33 
59 
32 
iS. 

43 



60 
122 

95 
15Z 

109 



MteoGOBtpiittt Group 

0301. JC 55 

0302. WC 53 
0305.LL 29 
0312J^ 62 
0315JM H 



127 
107 
83 
161 



Average 47 110 

Unweighted differeiKe « +23 pdnts or 4- 49%. 
Wd^ted diffn^^ » +69 points or +63%. 



84 

65 

39 
101 

70 



192 
196 
111 

299 

179 



Nakhleb/Kxajdk Ixvds oi Infbrntttitm of Different Technolt^ies Draft 



page 24 



Table 2 

Ctme^ Map Sci»»s of Wplghted ami Unwplghted Unacceptabfe RglaHimships by Treatment Croup 



Qoup 



Unweighted Weighted 
Relations Qoss Links 



Unweij^ted Weighted 
Relations Crosslinks 



Chemical Iad.'.c«u»r Gxoup 

0103.CP 

OIILDH 

01135$ 
0n4.TH 



46 
39 

d2 
68 
& 



Average 60 
Unwe^ted difference « -4 potnte or -7%, 
Weighted difference » -25 points or -14%. 



172 
93 
271 
212 

m 

185 



47 
39 
77 
68 

56 



164 
129 
248 
149 

m 

160 



pH Meter Gnmp 



0204.5K 50 

omjx; 46 

O^.CS 58 

AvCTUge 64 



Unweighted dtffierenoe s .5 points or -8%. 
Wei^ted difference * +9 points or -1-5%. 



140 36 45 

91 45 81 

184 62 287 

165 59 174 



M&toconqmter Group 



0301.JC 30 

03a2.WC 63 

03(».IX 36 

0312JV7M 71 

0315JM SI 

Average 50 



Unwdg^ted difiierence » 4-12 points or -«-24%. 
Weighted difference « ♦TS points or +49%. 



93 21 48 

216 73 293 

63 27 99 

242 104 482 

m Mm 

160 62 238 



2(> 

Nakhldi/Krapk Levels <rf Information of CHfiemtt Technologies Draft 



Table 3 

rririral Mndw In Confgpl Maps for the Chemifti] Indicator Group 

Om^ Pietpeatment Times Posttreatment Times 

Nodes Referenced Nodes Referenced 



0103.CP 



Olll.DH 



oin.ss 



OIM.TH 



Harmfulness 3 
Solution* 4 
Water* 3 



Hydrc^en 3 
Oi ■ ion* 3 
C^cj^en 3 



Qmness 
H+ion* 

Neutral* 
Vinegars 

pH7 



3 
3 

3 
3 



Hydrogen 

Midpoint 

Neutral* 

pH7 

Solution* 

Oxygen 
Strength 
Togetifier 
Water* 

Particles 



Neutral* 

pH7 

Strength 

Elements 
Midpoint 



5 
3 
4 
6 
5 

3 
14 
3 
4 



5 
3 
7 

4 

3 



Note . Nodes which are also expert critical nodes are starred. 
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Tabled 

Agrgptabk fViHr al TtfnA»a In Cimtv^ Map« for thg pH Mrtgr Cmnp 

Groi^ Pretreatment Times Postireatm^t Times 

Nodes Referenced Nodes Referenced 



02O4.sk 


Midpoint 


4 


Noi« 






Strength 


4 






0206DG 


Neutral* 


3 


Neutral* 


4 






3 








Strength 


7 






0207.CS 


Ncme 


^k»1e 


Neutral* 


3 




Ncme 


NJone 


Burning 


3 








Harmfulness 


6 








Strragth 


11 



^fij^. Nodes which are also expert critical nodes are starred. 
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Tables 

Arwpfabig Critical Kadea in Cow«pt Maps far the MlerDcompnter Gnmn 



Qncnip 



PtctrBStmcnt 



Times 
Refersnoed 



Posttreabnent Hates 
Nodes Refatmced 



0301.IC 



OH- ions* 
pH7 

Water* 



3 
3 
5 
3 
3 



H+ions* 

Middle 
Neutral* 
OH- ions* 
Solution* 
Water* 



3 
3 
3 
4 

3 
3 
3 



O302.WC 



0305.LL 



0312^ 



0315JM 



Hydrogen 
OH- tons* 



Scale 



Color 
pH7 
Scale 
Structure 



Chemicals 

Hement 

Water* 



3 
3 



3 
3 
3 
4 



5 
3 
4 



Hydrc^en 8 
Phenolphthalein 4 

Smir 3 

pH7 5 

Strength 4 

Elements 3 

Equati(»» 3 

Hydrc^en 13 
Native chaige 5 

Neutral* 6 

OH- ions* 8 

pH7 3 

Ratio 10 

Water* 9 

Cranponents 3 

Elements 4 

Oxy^n 7 

Sour 3 



Note . Nodes which are also expert critical no^ are starred. 
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Mi^ Stowing 




.1 



^51 




micro com trial Qf»tif>. 



1 



Post tmwtow 





Figure 10. Pretresbnent tn«9 concspi for *820B.Ofl, pH 
meter group. 
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to liMp thBtn 
from 




conce^ for l^)20d.DR, pH m»ter 



41 



Pre 
interview 
f031S.NM 

Base 




4iJ 



Imtrvlftiir 




con^ tot mia.My!. 
m)crocampLtf»f group. 



